TALP-UPC at TREC 2005: Experiments Using a Voting Scheme Among Three Heterogeneous QA Systems
نویسندگان
چکیده
This paper describes the experiments of the TALPUPC group for factoid and ’other’ (definitional) questions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA systems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For defitional questions, we used two different systems: the TALP-QA Definitional system and LCSUM (a Summarization-based system). Our results for factoid questions indicate that the voting strategy improves the accuracy from 7.5% to 17.1%. While these numbers are low (due to technical problems in the Answer Extraction phase of TALPQA system) they indicate that voting is a succesful approach for performance boosting of QA systems. The answer to definitional questions is produced by selecting phrases using set of patterns associated with definitions. Its results are 17.2% of F-score in the best configuration of TALP-QA Definitional system.
منابع مشابه
The TALP-UPC Approach to Tweet-Norm 2013
This paper describes the methodology used by the TALP-UPC team for the SEPLN 2013 shared task of tweet normalization (Tweet-Norm). The system uses a set of modules that propose different corrections for each out-of-vocabulary word. The final correction is chosen by weighted voting according to each module accuracy.
متن کاملTALP-QA System at TREC 2004: Structural and Hierarchical Relaxation Over Semantic Constraints
متن کامل
The GeoTALP-IR System at GeoCLEF-2005: Experiments Using a QA-based IR System, Linguistic Analysis, and a Geographical Thesaurus
This paper describes GeoTALP-IR system, a Geographical Information Retrieval (GIR) system. The system is described and evaluated in the context of our participation in the CLEF 2005 GeoCLEF Monolingual English task. The GIR system is based on Lucene and uses a modified version of the Passage Retrieval module of the TALP Question Answering (QA) system presented at CLEF 2004 and TREC 2004 QA eval...
متن کاملExperiments and Analysis of LCC ’ s two QA Systems over TREC 2004
In 2004, LCC has participated to TREC QA with two systems; PowerAnswer 2 and PALANTIR. The goal was to study the contribution of new features such as: (1) an improved passage retrieval module based on the Lucene IR system, (2) multiple QA strategies with voting across strategies, (3) the use of text semantic relations, (4) a new method for extracting lexical chains, (5) new logic prover reasoni...
متن کاملUNT 2005 TREC QA Participation: Using Lemur as IR Search Engine
This paper reports our TREC 2005 QA participation. Our QA system EagleQA developed last year was expanded and modified for this year’s QA experiments. Particularly, we used Lemur 4.1 (http://www.lemurproject.org/) as the Information Retrieval (IR) Engine this year to find documents that may contain answers for the test questions from the document collection. Our result shows Lemur did a reasona...
متن کامل